Papers with conditional language model
Document Summarization with Latent Queries (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing benchmarks for query-focused summarization are small for training large neural models. |
| Approach: | They propose a unified modeling framework for query-focused summarization . they model queries as discrete latent variables over document tokens . |
| Outcome: | The proposed framework outperforms strong comparison systems across benchmarks, query types, document settings, and target domains. |
Pretraining Sentiment Classifiers with Unlabeled Dialog Data (P18-2)
Copied to clipboard
| Challenge: | Existing methods to train sentiment classifiers with unlabeled data are costly and time-consuming. |
| Approach: | They propose a conditional language model with unlabeled dialog data instead of a language model to pretrain sentiment classifiers. |
| Outcome: | The proposed strategy outperforms state-of-the-art methods with unlabeled dialog data and is simple but effective. |
PROTAUGMENT: Unsupervised diverse short-texts paraphrasing for intent detection meta-learning (2021.acl-long)
Copied to clipboard
| Challenge: | Recent research considers few-shot intent detection as a meta-learning problem because of labeled data scarcity and the number of classes involved. |
| Approach: | They propose a meta-learning algorithm for short texts classification that limits overfitting on the bias introduced by the few-shots classification objective at each episode. |
| Outcome: | The proposed algorithm limits overfitting on the bias introduced by the few-shots classification objective at each episode. |
Generating Label Cohesive and Well-Formed Adversarial Claims (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on adversarial triggers for fact checking models reveals weaknesses and flaws of models . universal adversarials often inadvertently invert the meaning of instances they are inserted in . |
| Approach: | They propose a method for automatically generating highly potent, well-formed, label cohesive claims for FC using universal adversarial triggers. |
| Outcome: | The proposed method maintains the directionality and semantic validity of the claim better than previous work on the FEVER dataset. |
Learning to Infer from Unlabeled Data: A Semi-supervised Learning Approach for Robust Natural Language Inference (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Semi-supervised learning (SSL) is a popular technique for reducing the reliance on human annotations for NLI tasks. |
| Approach: | They propose a way to incorporate unlabeled data into semi-supervised learning (SSL) using a conditional language model, they propose to generate hypotheses for unlabed sentences . |
| Outcome: | The proposed framework significantly improves the performance of four NLI datasets in low-resource settings. |
Comparison of Diverse Decoding Methods from Conditional Language Models (P19-1)
Copied to clipboard
| Challenge: | Conditional language models can generate a diverse set of outputs, but for open-ended tasks, beam search is ill-suited to generating a set of diverse sequences. |
| Approach: | They propose a method where we over-sample candidates and use clustering to remove similar sequences to achieve high diversity without sacrificing quality. |
| Outcome: | The proposed method over-samples candidates and removes similar sequences to achieve high diversity without sacrificing quality. |
Domain Private Transformers for Multi-Domain Dialog Systems (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large general purpose language models have demonstrated impressive performance across many different domains, but their outputs are not guaranteed to stay within the domain of a given input prompt. |
| Approach: | They propose to quantify how likely a conditional language model will leak across domains by defining domain privacy as a way to fine-tune a model's privacy. |
| Outcome: | The proposed method has comparable resiliency to methods adapted from recent literature on differentially private language models. |